IN THE CLAIMS: 



of 



1 . (currently Amended) A computer-implemented face recognition 
process for identifying>a person depicted in an input image, comprising using a 
computer to perform theVollowing process actions: 

creating a database of a plurality of model image characterizations, 
each of which represents tnfe face of a known person that it is desired to identify 
in the input image as well as Vie person's face pose; 

compar i ng a r e g i on d e p i ct i ng th e fac e of a p e rson, wh i ch has b ee n 
e xtract e d from sa i d i nput imag e \and charact e r i z e d in a mann e r s i m il ar to th e 
p l ur ali ty of mod el i m a g e s, to th e lplura li ty of mod el imag e charact e rizat i ons; 

asc e rta i n i ng wh i ch of th e p l ura li ty of mod el i mag e charact e r i zat i ons 
most c l oso l y matches tho s i m il afty^b^ract e rizod i nput imago rog i on; and 

d e s i gn a t i ng th e i nput i mag e r e g i on to b e th e p e rson associat e d w i th 

th e most c l os el y match i ng mod el i rpag e charact e r i zation i f a d e gr ee of s i m il ar i ty 
e xc ee ds a pr e scr i b e d thr e shold- 
training a neural netwbrk ensemble to identify a person and their 
face pose from a region which has Been extracted from said input image and 
characterized in a manner similar to the plurality of model images, wherein the 



which has input and output units and 


piai^ iigiviiiv^ a ijiuiaiuy ui isioooi 11^1 0 t/aoi 1 ui 

is dedicated to a particular pose range and 


outputs a measure of the similarity in 


Jicative of the similarity between said 


characterized input image region anc 


each of said model image characterizations 


associated with the particular pose n 


inge of the classifier, and a fusing neural 


network as its second stage which c 


Dmbines the outputs of the classifiers to 


generate an output indicative of the, 


person associated with the characterized 


input image region; and / 

employing the netwo/k ensemble to identify the person associated 



with the characterized input imagg region. 
2-4. (cancelled) 



3 



cn/ 



5. (currently amended) The process of Claim 4-1, wherein the process 
actiorf-for training the neuralVietwork ensemble comprises an action of preparing 
each model image characterization from a model image depicting the face of a 
known person that it is desiredto identify in the input image by, 

extracting the portion of the model image depicting said face, 
normalizing the extracted portion of the model image by resizing it 
to a prescribed scale if not alreadv at the prescribed scale and adjusting the 
region so that the eye locations of Ifie depicted subject fall within a prescribed 
area, and 

cropping the extractedlportion of the model image by eliminating 
unneeded portions of the image not specifically depicting part of the face of the 
subject to create a model face image\ 

6. (currently amended) Thd process of C l am Claim 5, wherein the 
process action for training the neural rjetwork ensemble further comprises 
actions for: 

categorizing the model ftice images by assigning each to one of a 
set of pose ranges into which its asso :iated face pose falls; 

for each pose range, 

choosing a presc ribed number of the model face images of 
each person being modeled which toive been assigned to the selected pose 
range, 

concatenating e;ach of the chosen model face images to 
create a respective dimensional colu Tin vector (DCV) for each, 

computing a covariance matrix from the DCVs, 
calculating eiger vectors and corresponding eigenvalues 
from the covariance matrix, 

ranking the eige lvalues in descending order, 
identifying a pre* cribed number of the top eigenvalues, 



using the eigenv 



ctors corresponding to the identified 




eigenvalues to form the rows of a basis vector matrix (BVM) for the pose range; 
and \ 

multiplying each DCV by each BVM to produce a set of 
principal components analysis (PuA) PGA coefficient vectors for each model 
face image. \ 



7. (currently amended) The process of Claim 6, wherein the n e ura l 



(V 



n e twork e ns e mb le e mp l oyed compr 



communicat i on w i th i nput un i ts of a 



s e s a p l ura li ty of fac e r e cognition n e ura l 



networks e ach of wh i ch has i nput ar d output units and i s dod i catod to a 
part i cu l ar pos e rang e , said fac e recogn i tion n e ura l n e tworks output units b ei ng i n 



using neural network wh i ch has at least 
enough output units to allow a different output to represent each person it is 
desired to identify at each of the pose ranges, and wherein the process action of 
training the neural network ensemble further comprises the actions of: 

for each face recognition neural network, inputting, one at a time, 
each of the PCA coefficient vectors associated with the pose range of the face 
recognition neural network into the/ inputs of the network until the outputs of the 
network stabilize; 

initializing the fusind neural network for training; 
for each DCV, simultaneously inputting the PCA coefficient vectors 
generated from the DCV into the respective face recognition neural network 
associated the vector's particular pose range group until all the PCA coefficient 
vectors of every DCV have been input, and repeating until the outputs of the 
fusing neural network stabilize and 

for each DCV, simultaneously inputting the PCA coefficient vectors 
generated from the DCV into/the respective face recognition neural network 
associated the vector's particular pose range group and assigning the active 
output of the fusing neural network as corresponding to the particular person and 
pose associated with the mpdel image used to create the set of PCA coefficient 
vectors. 



8. (currently amenfled) The process of Claim 7, wherein the process 
action of employing the neural network ensemble to identify the person depicted 
in the input image face region and tho poso associated with tho faco of tho 
id e ntifi e d person , comprises the actions of: 



preparing the 
normalizing and cropping th 
comprises resizing the extra 



ace region extracted from an input image by 
extracted regions, wherein said normalizing 
ted face region to the same prescribed scale if not 
already at the prescribed scale and adjusting the region so that the eye locations 
of the depicted subject fall within a prescribed area, and wherein the cropping 
comprises eliminated unneeded portions of the image not specifically depicting 
part of the face of the subject 

concatenating the prepared face region to create a DCV; 
multiplying theC >CV by each BVM to produce a set of PCA 
coefficient vectors for the exacted face region; 

inputting each PCA coefficient vector in the set of PCA coefficient 
vectors into the respective faqe recognition neural network associated that 

group; and 

ctive unit of the output of the fusing neural network 
and designating the person and pose previously assigned to that unit as the 
person and pose associated with the extracted face region. 



vector's particular pose rang^ 
identifying the a 



9. (currently amended 



The process of Claim 3 1, wh e r e in tho further 



comprising process actions for des i gnat i ng tho i nput imago rog i on to bo an 
unknown porcon compr i s e s t l e actions of : 



training the neural network ensemble to identify the person 
associated with the character zed input image region to be an unknown person if 
it does not match any of the n^odel image characterization to a prescribed 
degree; and 

employing the ndural network ensemble to identify the person 
associated with the characterized input image region to be an unknown person if 
it does not match any of the model image characterization to the prescribed 



• 



degree/ 



10. (currently amended) A face recognition system for identifying a 
person depicted irNan input image, comprising: 

a genetel purpose computing device; and 
a computer program comprising program modules executable by 
the computing device, wherein the computing device is directed by the program 
modules of the computerWogram to, 

captulte model images, each of which depicts at least one 
person of known identity, \ 

locate arid extract regions within the model images, each of 
which depicts the face of a kroown person that it is desired to identify in the input 
image, \ 

determine the face pose for each of the face regions 
extracted from the model images, 

categorize jeach face region by assigning each to one of a 
set of pose ranges into which its associated face pose falls, 



capture sak 



l ocate and extract reg i ons w i thin tho i nput i mages, oach of 



wh i ch depicts tho faco of a porsc n, and 



compar i ng th e fac e r e g i on to tho 



i nput i mag e , 



for oach faco r e g i on oxtractod from tho input i mago, 



fac e r e g i ons ass i gn e d to oach pos e rang e to 



identify tho porson depicted in th 3 input imago faco rog i on 



train a neun 



I network ensemble to identify a person and 



their face pose from a region that depicts the face of a person which has been 



extracted from said input image. 



wherein the network ensemble comprises, a first 



stage having a plurality of classifiers each of which has input and output units 



1 



similarity indicative of the simild 


ritv between said input image region and each of 


said model image regions assc 


ciated with the particular pose range of the 


classifier, and a fusing neural r 


etwork as its second stage which combines the 




7 



outputs of the classifiers td generate an output indicative of the person 
associated with the characterized input image region; and 

employing the network ensemble to identify the person associated 
with the characterized input unage region and their face pose. 

11-14. ^cancelled) 

/-V) 15. (currently amended) \ The system of Claim 44-10, wherein the sub- 
' modiile for training the neural nek/vork ensemble comprises a sub-module for 
preparing each face region extracted from said model images by normalizing and 
cropping the extracted regions, wherein said normalizing comprises resizing 
each extracted face region to the same prescribed scale if not already at the 
prescribed scale and adjusting each region so that the eye locations of the 
depicted subject fall within the samp prescribed area, and wherein said cropping 
comprises eliminating unneeded portions of the image not specifically depicting 
part of the face of the subject. 

16. (currently amended) the system of Clam 15, wherein the sub- 
module for training the neural network ensemble further comprises sub-modules 
for: 

(a) selecting a p/eviously unselected one of the set of pose 

ranges; 

(b) choosing a brescribed number of the prepared face images 
of each person being modeled y/hich have been assigned to the selected pose 
range; 

(c) concatenating each of the chosen prepared face images to 
create a respective dimensional column vector (DCV) for each; 

(d) computing a covariance matrix from the DCVs; 

(e) calculating eigenvectors and corresponding eigenvalues 
from the covariance matrix; 

(f) ranking the eigenvalues in descending order; 



8 



(g) identifying a prescribed number of the top eigenvalues; 

(h) using the eigenvectors corresponding to the identified 
eigenvalues to form the rows of a basis vector matrix (BVM) for the selected 
pose range; \ 

(i) repeating actions (a) through (h) for each remaining pose 

range; 



(j) multiplying each 
principal components analysis (PCA^ 



DCV by each BVM to produce a set of 
PGA coefficient vectors for each face 



image. 



1 7. (currently amended) Thfe system of Claim 1 6, wherein the noura l 
n e twork onsomb l o omployod oompmsos a p l ural i ty of faco rocognition noura l 
n e tworks oach of wh i ch has i nput and output units and i s dodicatod to a 
<y particu l ar poso rango, said faco recognition neural networks output units boing i n 
^ commun i cat i on w i th input un i ts qt a fusing neural network which has at least 
enough output units to allow a different output to represent each person it is 
desired to identify at each of the pose ranges, and wherein the sub-module for 
training the neural network ensemble further comprises sub-modules for: 

for each face recognition neural network, inputting, one at a time, 
each of the PCA coefficientA/ectors associated with the pose range of the face 
recognition neural network/into the inputs of the network until the outputs of the 
network stabilize; 

initializing tjie fusing neural network for training; 

for each DCV, simultaneously inputting the PCA coefficient vectors 
generated from the DCy into the respective face recognition neural network 
associated the vector'sjparticular pose range group until all the PCA coefficient 
vectors of every DCV have been input, and repeating until the outputs of the 
fusing neural network stabilize; and 

for each DCV, simultaneously inputting the PCA coefficient vectors 
generated from the DCV into the respective face recognition neural network 
associated the vector's particular pose range group and assigning the active 
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output of the fusing neural network as corresponding to the particular person and 
pose associated with the model ipiage used to create the set of PCA coefficient 
vectors. 

18. (original) The system of Claim 17, wherein the sub-module for 
employing the neural network ens€ mble to identify the person depicted in the 
input image face region and the pose associated with the face of the identified 
person, comprises sub-modules fo" 

preparing the face re jion extracted from an input image by 
normalizing and cropping the extracted regions, wherein said normalizing 
comprises resizing the extracted f<ice region to the same prescribed scale if not 
already at the prescribed scale an i adjusting the region so that the eye locations 
of the depicted subject fall within ci prescribed area, and wherein the cropping 
comprises eliminated unneedec^oortions of the image not specifically depicting 
part of the face of the subject; ^ 

concatenating the prepared face region to create a DCV; 

multiplying the DCV by each BVM to produce a set of PCA 
coefficient vectors for the extracted face region; 

inputting each PGA coefficient vector in the set of PCA coefficient 
vectors into the respective face recognition neural network associated that 
vector's particular pose range/group; and 

identifying the active unit of the output of the fusing neural network 
and designating the person and pose previously assigned to that unit as the 
person and pose associated with the extracted face region. 



1 9. (currently amended) The system of Claim +3 10, whoro i n tho 
program modu le for d e s i gnat i ng th e fac e r e g i on e xtract e d from th e i nput i mag e to 
b e an unknown p e rson compr i s e s further comprising sub-modules for: 

training a thle neural network ensemble to identify the person 
associated with the input image face region to be an unknown person if it does 
not match any of the face! regions assigned to each pose range to a prescribed 
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degree; ar 

lploying the neural network ensemble to identify the person 
associated with thfejnput image face region to be an unknown person if it does 
not match any of the race regions assigned to each pose range to a prescribed 
degree. 



20. (currently amended) A computer-readable memory for use in 
identifying a person depictedVi an input image, comprising: 
a computer-readable storage medium; and 
a computer program comprising program modules stored in the 
storage medium, wherein the storage medium is so configured by the computer 
program that it causes a computento, 

input model images, each of which depicts at least one 
person of known identity, 

locate and extrabt regions within the model images, each of 
which depicts the face of a known person that it is desired to identify in the input 
image, 

determine the facjp pose for each of the face regions 
extracted from the model images, 

categorize each fdce region by assigning each to one of a 
set of pose ranges into which its associated face pose falls, 

captur e sa i d input i mag e , 
l ocate and oxtracl r e g i on s w i thin tho i nput i mages, oach of 



wh i ch d e p i cts tho fac e of a person, ar 



for e ach fac e r e g/on e xtract e d from the input i mago, 

comparing tho faco reg i on to tho fc ^ T ^ 

ident i fy the person dop i ctod i n tho i nput i mago faco rogion. 

train A neural nrfmA/nrk pncomhlo tn iH^ntif 



their face oose from a reaion depict 


nq the face of a person which has been 


extracted from said input imaae. wh 


erein the network ensemble comprises, a first 


staae having a plurality of classifier 


5 each of which has input and output units 







and is dedicated to ^particular pose range and outputs a measure of the 
similarity indicative ofVie similarity between said input image region and each of 
said model image regions associated with the particular pose range of the 
classifier, and a fusing neural network as its second stage which combines the 
outputs of the classifiers ro generate an output indicative of the person 
associated with the characterized input image region; and 

employing theinetwork ensemble to identify the person associated 
with the characterized input Image region and their face pose. 



21-24. (cancelled) 



AO 

^ x^O 25 - ( current| y annexed) The computer-readable memory of Claim 24 
20, wnerein the sub-moduletfor training the neural network ensemble comprises 
a sub-module for preparing each face region extracted from said model images 
by normalizing and cropping the extracted regions, wherein said normalizing 
comprises resizing each extracted face region to the same prescribed scale if not 
already at the prescribed scale and adjusting each region so that the eye 
locations of the depicted subject fall within the same prescribed area, and 



wherein said cropping comprises 



eliminating unneeded portions of the image not 



specifically depicting part of the U ice of the subject 



26. (currently amended) The computer-readable memory of Clam 25, 
wherein the sub-module for trainjng the neural network ensemble further 
comprises sub-modules for: 

(a) selecting a previously unselected one of the set of pose 

ranges; 

(b) choosing k prescribed number of the prepared face images 
of each person being modeled which have been assigned to the selected pose 
range; 

(c) concatenating each of the chosen prepared face images to 
create a respective dimensional column vector (DCV) for each; 
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(d) computing a covariance matrix from the DCVs; 

(e) calculating eigenvectors and corresponding eigenvalues 
from the covariance matrix; 

(f) ranking the eigenvalues in descending order; 

(g) identifying a prescribed number of the top eigenvalues; 

(h) using th 3 eigenvectors corresponding to the identified 
eigenvalues to form the rowj; of a basis vector matrix (BVM) for the selected 



pose range; 



range. 



(i) repeatir g actions (a) through (h) for each remaining pose 



(j) multiplyi 



'ing each DCV by each BVM to produce a set of 
principal components analysis (PCA) PGA coefficient vectors for each face 
image. 



27. (currently amended) The computer-readable memory of Claim 26, 
wherein the neura l notwrirk onoomblo omp l oyod compr i ses a plura l ity of faco 
r e cogn i tion n e ura l n e tworks oach of wh i ch has i nput and output units and is 
d e d i cat e d to a part i cu l ar pos e rang e , sa i d fac e r e cognit i on n e ural networks 
output un i ts b e ing i n commun i cat i on w i th input un i ts of a fusing neural network 
wh i ch has at least endugh output units to allow a different output to represent 
each person it is desired to identify at each of the pose ranges, and wherein the 
sub-module for training the neural network ensemble further comprises sub- 
modules for: 

for eadh face recognition neural network, inputting, one at a time, 
each of the PCA coefficient vectors associated with the pose range of the face 
recognition neural njetwork into the inputs of the network until the outputs of the 
network stabilize; 

initializing the fusing neural network for training; 

for eaih DCV, simultaneously inputting the PCA coefficient vectors 
generated from the DCV into the respective face recognition neural network 
associated the vectors particular pose range group until all the PCA coefficient 
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vectors of every DCV have been input, and repeating until the outputs of the 
fusing neural network stabilize; and 

for each DCVAsimultaneously inputting the PCA coefficient vectors 



generated from the DCV intc 



the respective face recognition neural network 



associated the vector's particular pose range group and assigning the active 
output of the fusing neural network as corresponding to the particular person and 
pose associated with the mo|el image used to create the set of PCA coefficient 
vectors. 



28. (original) The computer-readable memory of Claim 27, wherein the 
sub-module for employing the* neural network ensemble to identify the person 
depicted in the input image fece region and the pose associated with the face of 

es sub-modules for: 

ce region extracted from an input image by 
extracted regions, wherein said normalizing 



the identified person, compri 

preparing the 
normalizing and cropping the 
comprises resizing the extracted face region to the same prescribed scale if not 
already at the prescribed scale and adjusting the region so that the eye locations 
of the depicted subject fall within a prescribed area, and wherein the cropping 
comprises eliminated unneeded portions of the image not specifically depicting 
part of the face of the subjec :t; 

the prepared face region to create a DCV; 
DCV by each BVM to produce a set of PCA 
racted face region; 
inputting eadh PCA coefficient vector in the set of PCA coefficient 
vectors into the respectivepace recognition neural network associated that 
vector's particular pose range group; and 

identifying the active unit of the output of the fusing neural network 
and designating the perse >n and pose previously assigned to that unit as the 
person and pose associated with the extracted face region. 



concatenating 
multiplying the 
coefficient vectors for the e] 



29. (currently amended) The computer-readable memory of Claim 23 
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20, wher e in the program modu l o for d e s i gnat i ng tho faco r e gion extracted from 
th e i nput i mag e to be an unkpown p e rson compr i ses further comprising sub- 
modules for: 

training a neuraO network ensemble to identify the person 
associated with the input image face region to be an unknown person if it does 
not match any of the face regilpns assigned to each pose range to a prescribed 
degree; and 

employing the nebral network ensemble to identify the person 
associated with the input image face region to be an unknown person if it does 
not match any of the face regions assigned to each pose range to a prescribed 
degree. 

30. (cancelled) 

S 31 - (currently amenqed) The process of Claim 30 1, wherein the 
process action for training tne network ensemble comprises an action of deriving 
each model image characterization from a set of model images of people, 
wherein each model image of the same person shows that person at a different 
face pose , said deriving action comprising: 

extracting the portion of each model image depicting a face; 

normalizing the extracted portion of each model image by resizing it 
to a prescribed scale if not already at the prescribed scale and adjusting the 
region so that the eye location^ of the depicted subject fall within a prescribed 
area; 

cropping the extracted portion of each model image by eliminating 
unneeded portions of the imdge not specifically depicting part of the face of the 
subject to create a model fade image; 

concatenating feach of the model face images to create a respective 
model dimensional column \fector (DCV) for each, 

categorizing thte model DVC s DCVs by assigning each to one of a 
set of pose ranges into which its associated face pose falls; 
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inputting the mo jel OVG DCV of the each model face image falling 
in a particular pose range, onf at a time, to a pre-selected classifier dedicated to 
the particular pose range. 

32. (currently amendec ) The process of Claim 31 , wherein the process 
action of training the network ensemble further comprises the actions of: 

initializing the fusing nejral network for training; 

simultaneously ir putting the respective OVG DCV of each model 
face image into all classifiers, until the OVG DCV of every model image has been 
input, and repeating until the o jtputs of the neural network stabilize; and 

simultaneously in Dutting the respective OVG DCV of each model 
face image into all classifiers, end assigning the active output the neural network 
as corresponding to the particular person and pose associated with the model 
image used to create the DCV. 



preparing the face 
normalizing and cropping the e. 



33. (currently amended) The process of Claim 32, wherein the process 
action of employing the network ensemble to identify the person depicted in the 
input image face region, comprises the actions of: 

region extracted from an input image by 
tracted regions, wherein said normalizing 
comprises resizing the extracted face region to the same prescribed scale if not 
already at the prescribed scale and adjusting the region so that the eye locations 
of the depicted subject fall witnin a prescribed area, and wherein the cropping 
comprises eliminated unneeded portions of the image not specifically depicting 
part of the face of the subject; 

concatenating the prepared face region to create a DCV; 
inputting the SVG DCV of the face region into all classifiers; and 
identifying the active output of the neural network and designating 
the person previously assigned to that unit as the person associated with the 
extracted face region. 



*P\/ action of specifying that the 



34. (original) The process of Claim 33, further comprising a process 

person designated as associated with the extracted 
face region has the face po$e previously assigned to the identified active output. 



35-42. (withdrawn) 
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